Half-duplex and full-duplex interference mitigation in relays assisted heterogeneous network

In a multicell environment, the half-duplex (HD) relaying is prone to inter-relay interference (IRI) and the full-duplex (FD) relaying is prone to relay residual-interference (RSI) and relay-to-destination interference (RDI) due to Next Generation Node B (gNB) traffic adaptation to different backhaul subframe configurations. IRI and RDI occur in the downlink when a relay is transmitting on its access link and interfering with the reception of a backhaul link of another victim relay. While the simultaneous transmission and reception of the FD relay creates the RSI. IRI, RDI, and RSI have detrimental effects on the system performance, leading to lower ergodic capacity and higher outage probability. Some previous contributions only briefly analysed the IRI, RSI, and RDI in a single cell scenario and some assumed that the backhaul and access subframes among the adjacent cells are perfectly aligned for different relays without counting for IRI, RSI and RDI. However, in practise the subframes are not perfectly aligned. In this paper, we eliminate the IRI, RSI, and RDI by using the hybrid zeroforcing and singular value decomposition (ZF-SVD) beamforming technique based on nullspace projection. Furthermore, joint power allocation (joint PA) for the relays and destinations is performed to optimize the capacity. The ergodic capacity and outage probability comparisons of the proposed scheme with comparable baseline schemes corroborate the effectiveness of the proposed scheme.


Introduction
5G wireless network runs applications that require high demand for data rates. One of the solutions to solve the data rate requirement is to densify the network by deploying small cells. Such densification can reduce power consumption and offer higher spectral efficiency. Heterogeneous network offers significantly cost-effective means to enhance the capacity of the wireless cellular communication systems by permitting a variety of infrastructure nodes, including HD and FD relays, small cells, etc., to connect to the current multicell networks [1]. Small cells such as Femto and Pico varying sizes with low transmitted power are the most economic solutions. The main hurdle facing relay assisted heterogeneous network is the interference between nodes such as the relay may cause interference to another relay (IRI) and destination, referred to as relay-to-destination interference (RDI) in addition to relay residual-interference (RSI) the RSI is unknown [11]. With no bandwidth constraints and according to channel condition, the FD system can automatically switch its RSI cancellation. This system is restrained by practical limitations such as delay and signal attenuation [12]. An inband FD radio decreases the RSI level to noise floor is proposed in [13]. In an FD two-hop network, the relay acts as a multiple antennas FD node, the effect of resource allocation is studied [14], in which the impact of the relay distance from the transmitter, the number of antennas, and different RSI modes are investigated. In addition, maximizing the effective signal-to-interference-and-noise-ratio (SINR) leads to minimizing the outage probability, and the optimal choice between the HD and FD is calculated [10,15]. In a small cell network and under certain power constraints, the spectral efficiency is maximized by a joint beamforming design [16][17][18]. The ergodic capacity comparison between the FD and HD relay is evaluated after modeling the FD relay with RSI, it is shown that the FD outperforms the HD relay [19] at low SNR [10] via numerical simulation. The capacity trade-off of HD and FD is analyzed for the total system in a two-hop amplifyand-forward (AF) relay. Allowing some SINR degradation with the FD mode is preferable to using two-time slots to eliminate RSI with the HD mode [20]. The FD hybrid BF technique is proposed in [1], where the sum rate capacity is improved by approximately doubling it due to the successful cancellation of the strong self-interference power.
On the other hand, an interest in multi-antenna technology has been witnessed in the past few years, which provides higher capacity and improves network coverage. Since the source, relay and destination equipped with multiple antennas, beamforming technique can be performed. The latest research considers the IRI, RSI and RDI to be perfectly mitigated [21] and others focus on designing beamforming techniques to cancel the interference in MIMO FD relay systems as shown in Table 1. A MIMO beamforming technique such as ZF is applied to suppress the interference or maximize the useful signal [1]. The performance of cognitive MIMO relay is analyzed by deploying selective zeroforcing beamforming and phase alignment. The ergodic capacity bound of FD relay for two sources has been investigated in [22], in addition, calculating the channel ergodic capacity, for example, the ergodic capacity of multicast channels is analyzed in [23].
In the spatial domain, the self-interference mitigation schemes such as beam selection, antenna selection, minimum-mean-squared-error (MMSE), and nullspace projection are proposed, where the relay is equipped with transmit and receive beamforming matrices. However, in the ideal case with perfect channel information, only nullspace projection can eliminate the residual interference [8,18]. By maximizing the SINR, [24] suppresses the relay self-interference substantially with less impact on the desired signal. For FD wideband AF MIMO relays, SINR maximization based on RSI mitigation is proposed in [25,26]. The DF capacity is maximized via joint optimization for the digital and analog transceiver is considered [17], to suppress the RSI, an additional adaptive technique was designed based on additional hardware. However, the system did not capture the network heterogeneity.
The study of [27,28] evaluated the SNR of separate cells and concluded that a relay node can further improve the ergodic capacity by relay placement and ignoring the interference from neighboring cells. In a single cell network, [10] analyzed the effects of different RSI and RDI levels, the system performs worse at high SNR in terms of both outage probability and ergodic capacity. Reference [29] did not consider any channel model, but only fixed channel gain, in lieu, the SINR value is set to 10 dB for all hops. In this paper, we proposed a simplified and yet effective joint interference mitigation scheme for heterogeneous networks consisting of FD communication system and HD communication system called hybrid method.
To further improve the system performance, power efficiency is a vital design consideration. Although power allocation algorithms have been widely studied in multiple-input multiple-output (MIMO) systems [14,30], the existing schemes cannot be directly applied to Each symbol-vector will be received twice in two con-secutive time slots, which restricts the FD performance. The transceiver needs to be redesigned to exploit the extra receive diversity and cancel interfer-ence. It only explored RSI Single Relay [33] Optimal transceiver and relay processing algorithms for an FD AF MIMO two -way relaying system RSI Average Capacity Accounts for RSI mitigation at each node and uses iterative technique to estimate the error accumulated over time The system requires two time slots which does not explore the full FD capacity. Channel inver-sion may not perform well in a one way two hop network due to network requirement Single Relay [34] Performance of coopera-tive multicell downlink communica-tion aided by polarization-multiplexing under limited feedback constraints RDI and IRI Average Capacity Polarized antennas in combination with joint preprocessing at the BSs and relays is regarded as an efficient technique for the cooperative multicell down-link system to deal with the space constraints The joint pro-cessing suffered from feedback and backhaul delays.
Single Relay (Continued ) multicell network because of RSI, IRI and RDI. This is due to the different power requirements from the backhaul and access links. Uniform power allocation at each node has been generally adopted for ease of analysis and computation Meanwhile, in MIMO systems without interference, it has been shown that waterfilling power allocation algorithm is optimal. However, in a MIMO relay network, individual power allocation and aggregate power allocation have been shown to further improve the system power efficiency in a relaying scheme [10,14,31] and can further be extended to multicell network.

Contribution
Motivated by the above mentioned limitations in Table 1 and owing to the practical HD and FD MIMO relaying network, the interference between nodes such as the relay may cause interference to other relay (IRI) and destination referred as relay-to-destination interference (RDI) in addition to residual self-interference (RSI) due to the use of multiple transmit and receive antennas in a limited space, and also due to network heterogeneity [2]. This paper considers a heterogeneous multicell network assisted by FD and HD relaying. Interference-aware transceiver beamforming (BF) matrices based on hybrid zeroforcing and singular value decomposition (ZF-SVD) beamforming technique at the relays and destinations are designed to jointly eliminate the RSI, IRI and RDI. The effectiveness of the proposed scheme has been investigated through Monte Carlo simulations. The results show that the proposed system can achieve better ergodic capacity, sum capacity, and outage probability performance than comparable baseline schemes. Due to the effectiveness of the proposed interference mitigation scheme, the proposed scheme achieves performance close to the ideal scheme without interference consideration. Finally, joint PA is proposed to further improve the system performance of our suboptimal scheme.

Paper outline
The rest of the paper is organized as follows. Next, we describe the system model in Section 2.
The beamforming design is discussed in Section 3. The capacity of the proposed scheme is derived in Section 4. Comparable baseline schemes derived from the literature are given in Section 5. From Section 6 we further improve the performance of our proposed scheme by joint PA in Section 7. Numerical results are given in Section 8, and Section 9 offers the concluding remarks.
In this paper, vectors and matrices are respectively represented by boldface lowercase letters (e.g.,x) and boldface uppercase letters (e.g., X). � and � denote the component wise inequality. " †" stands for the Moore-Penrose, {.} H represents conjugate transpose and ½x� þ ≜ maxfx; 0g, the expectation operator is given by E½:�; det(�) stands for the determinant; tr {.} is the trace of a matrix; the diagonal matrix that containing diagonal components

System model
Consider a practical heterogeneous network scenario where the system suffers from RSI, IRI, and RDI, as depicted in Fig 1. Such a network can be modeled in Fig 2, which shows the coexistence of FD and HD relay systems.
All HD sources, HD/FD relays, and low-mobility HD destinations which use half-duplex transmission instead of full-duplex to reduce the interference and share the channel by more than two nodes. (users) are equipped with multiple antennas. The source can't transmit to the destination directly, due to the effects of fading and shadowing, which makes sense for cases such as deploying the relay for coverage extension. In addition, the HD source S i wishes to communicate with HD destination D i through the FD relay R i in the cell i. While HD source S j wishes to communicate with HD destination D j through HD relay R j in the cell j such that S won't interfere with R and D, while the relays are deployed at the cell edge where the RSI, IRI and RDI courr. When R i is transmitting, it creates RSI to itself via the channel H R i , IRI to the other relay R j via channel H R i R j and RDI to the other node D j via the channel H R i D j . Likewise, when R j is transmitting, it creates IRI to the other relay R i via channel H R j R i and RDI to the other node D i via the channel H R j D i in addition to the receiver noise. Besides, additional interference may be caused by the Doppler effect due to for instance high-mobility planes, trains, etc., which could also be treated as part of the noise. All the channels are considered flat-fading spatially uncorrelated Rayleigh distributed. In other words, the entries of each channel matrix are independent and identically distributed (i.i.d.) complex Gaussian variables with zero-mean and unit variance. Further, the receiver channel state information (CSI) knowledge is assumed to be known.
The transmission protocol can be described in an odd and an even time slots. In the odd time slot t, the source S i transmits the message x S i to the FD relay R i , and simultaneously the source S j transmits to the HD relay R j . The FD relay R i simultaneously transmits and receives in the same frequency. This results in RSI through the channel H R i and IRI through H R i R j to the other relay R j . The following equations show the received message at FD relay R i and HD relay R j , respectively

PLOS ONE
To cancel the interferences, the relay R i applies transmit BF while R j applies receive BF. The received signal at the relay i and j with the application of BF can be rewritten respectively as Destination D i Within each time slot (which about usually hundreds mini-seconds), the geographic movement of low-mobility destinations (users) can be ignored. Hence, low-mobility destinations experienced zero Doppler spread. D i receives only from its desired relay R i , because R j is kept silent during this period due to HD constraint. The design of the receive and transmit BF matrices will be discussed in the following Subsection. The received signal at D i is shown below In the even time slot (t + 1), the source S i transmits the message x S i to the FD relay R i . The FD relay R i simultaneously transmits and receives in the same frequency, this causes RSI through the channel H R i : At the same time relay R i also receives IRI through channel H R j R i from the other relay R j . The following equation shows the received message at FD relay R i , To cancel the interferences, the R i and R j relays apply transmit BF. The received signal at the relay R i after applying the BF can be rewritten as The received signal at destination D i and D j are As shown in Eqs 8 and 9, the FD relay R i causes RDI to the D j . The HD relay R j causes RDI to the other destination D i through the channel H R j D i . To eliminate the RDI, the destinations apply the receive BF matrices W redi and W redj as follows The definitions of symbol vectors and channel matrices are shown in the following. x S 2 C minðM Si ;M ri Þ�1 , andx S 2 C minðM Sj ;M rj Þ�1 are the transmitted signals from the S node with dimension min(M Si , M ri ) × 1 and R node with dimension min(M Sj , M rj ) × 1, respectively.
are the channel gain matrices as shown in Fig 2. The summary of the odd and even time slots with their effective interferences are depicted in Table 2.
The power constraints on transmit signals are E½x y S x S � ¼ 1, E½x y Rx R � ¼ 1. y R 2 C N r �1 and y D 2 C N d �1 are the received signals at R and D nodes. The z R 2 C N r �1 and z D 2 C N d �1 are independent circularly symmetric complex Gaussian noise vectors with distribution CN ð0; N 0 I Nr Þ and CN ð0; N 0 I Nd Þ, and uncorrelated to x S and x R . I Nd and I Nr are identity matrices of order N d and N r respectively. The transmit SNRs can be expressed as

Beamforming design
To mitigate RSI, IRI, and RDI, and to carefully ensure that the desired signal is not removed, the BF matrices have been designed. The BF matrices are projecting these interferences into the nullspace.

Relay transceiver beamforming design
To simultaneously mitigate the RSI and IRI at the odd time slot, the following transmit and receive beamforming matrices based on nullspace projection of the interference channels [3,18] are proposed, From Eqs 3 and 4, it is clear that in order to zeroforce the RSI and IRI, the transmit and receive BF matrix W toi and W roj , respectively, are applied to project the RSI and IRI into the nullspace spanned by the interfering channels ðH R i ; On the other hand, at an even time slot, the RSI and IRI are canceled by projecting the transmit BF matrices W tei and W tej to a nullspace of the channels H R i and H R j R i . Mathematically, the following relay transmit BF matrices are proposed

PLOS ONE
In order to obtain non-zero nullspaces as in Eqs 14 to 17, the required dimensions are M ri � N ri + min(M si ,N ri ), N rj � min(M si ,N ri ) + min(M sj , N rj ) and M rj = N ri + min(M sj ,N rj ), and N di � min(M rj ,N dj ) + min(M ri , N di ), N dj � min(M ri ,N di ) + min(M rj ,N dj ), where min(M s , N r ), and min(M r ,N d ) are the number of the transmitted data streams which are also known as the rank of the channel. The dimension of the transmit BF matrices W toi 2 C minðN ri ;M si Þ�M ri , W tei 2 C minðN ri ;M si Þ�M ri ; W tej 2 C minðN rj ;M sj Þ�M rj , and receive BF matrix W roj 2 C M rj �minðN rj ;M sj Þ .

Destination beamforming design
At the even time slot, the receive BF matrices at the destination suppress the interference at the destination from unintended relay and maximize the desired signal. In other words, the BF matrices at the destination receivers W redi and W redj are designed to fulfill the ZF conditions: The destination receives beamforming matrices that can be obtained as follows At an odd time slot, no RDI occurs since there is only one transmitting relay. In this case, the transmit and receive BF matrices are designed for both relay R i and destination D i using conventional singular value decomposition (SVD). The SVD of the channel H R i D i can be decomposed into three matrices ðŨ iΛiṼ H i Þ, whereŨ i ;Ṽ i are unitary matrices, andΛ i are diagonal matrix of H R i D i , sorted in descending order, whose diagonal elementsλ 1 �l 2 ::: �l N 2 , and the number of independent streams for SR-hop is N 1 � min{N r , M s } and RD-hop N 2 � min{N d , M r }. The received signal at R i after SVD can be expressed as follows the dimension of the BF matrices W redi 2 C N ri �ðM ri À minðN ri À M si ÞÞ ; W redj 2 C N rj �ðM rj À minðN rj À M sj ÞÞ .

Capacity performance
The system performance is measured using the total MIMO relay channel capacities according to Shannon formula. The total FD relaying capacity C FD is a sum of the FD capacity during the odd time slot C o FD and the even time slot C e FD whereas the HD relaying capacity C HD is defined by the minimum capacity for the odd time slot C o S j R j and even time slot C e R j D j . However, these capacities for the two hops are computed as follows

Capacity of odd time slot-C o SR and C o RD
With the instantaneous received SNR at the relay, the capacities of the odd time slot for the SR-hop C o S i R i and C o S j R j are affected by the RSI and IRI which are respectively given by After applying the nullspace criteria Eqs 14 and 15, the Eqs 26 and 32 become while the capacity of the RD-hop C o R i D i is given by

Capacity of even time slot-C e SR and C e RD
With the instantaneous received SNR at the relay, the capacity of the even time slot for the SRhop C e S i R i is affected by the RSI and IRI, while C e S j R j is free of interference. Specifically, After applying the nullspace criteria Eqs 14 and 15, the Eqs 26 and 32 become while the capacity of the RD-hop C o R i D i is given by

Capacity of even time slot-C e SR and C e RD
With the instantaneous received SNR at the relay, the capacity of the even time slot for the SRhop C e S i R i is affected by the RSI and IRI, while C e S j R j is free of interference. Specifically, After applying the nullspace criteria in Eqs 16, 17 and 36 becomes Similarly, the capacity of destinations C e R i D i and C e R j D j with the RDI is respectively given as After applying the nullspace criteria in Eqs 18 and 19, Eqs 38 and 39 become

Baseline schemes for comparison
In order to validate the performance of the proposed heterogeneous scheme, this Section derived the comparable baseline schemes from the literature for bench-marking.

Ideal FD relay scheme (no interference)
This scheme does not consider the effect of the interferences. This upper bounds the ideal multicell capacity [10,18,[32][33][34][35]. The capacity of the ideal FD relaying scheme can be expressed as follows

FD relay without interference cancellation scheme (with interference)
This scheme considers the RSI, IRI and RDI effects without any suppression. Therefore, this scheme lower bounds the capacity of the proposed scheme [36]. The capacity of FD relay without interference cancellation can be expressed as

Capacity of even time slot with interference-C e SR IN and C e RD IN .
With the instantaneous received SNR at the relay, the capacity of the even time slot with interference for the SRhop C e S i R i; IN is affected by the RSI and IRI [36], Eq 13 given by Similarly the capacity of the destinations with interference C e R i D i;IN and C e R j D j;IN with the RDI [32,34] is respectively given as

Ideal HD relay scheme (no interference)
This scheme does not consider the effect of the interferences. This upper bounds the ideal multicell capacity. The HD relay capacity of SR-hop and RD-hop is given by [32], Eq 17 and [33], Eq 8] as below

Proposed scheme with waterfilling power allocation algorithm
In this Section, to maximize the total ergodic capacity, the effective transmit and receive BF matrices at the relay by using SVD have been designed. For the SR-hop, the SVD of the effective channels H SR and H RD can be decomposed into three matrices ðU i Λ i V H i Þ ¼ SVDðH SR Þ and ðŨ iΛiṼ H i Þ ¼ SVDðH RD Þ, respectively, as similar to [37], Eq 15 and [38], Eq 27. The SVD decomposes the channel into independent orthogonal sub-channels sorted in descending order, whose diagonal elements l 1 � l 1 ::: � l N 1 , andl 1 �l 2 ::: �l N 2 . The transmit signalx S is multiplied by the right singular matrix V i at the source. The received signal at the relay is multiplied by the left singular matrix U H i .
From Eqs 33 and 34, the ergodic capacity of SR-hop can be expressed as The ergodic capacity of RD-hop from Eqs 40 and 41 can be rewritten as Thus, the MIMO relay channel is converted to non-interfering SISO sub-channels with non-equal power. Since the source and relay power is fixed, the power must be divided among these sub-channels. Waterfilling algorithm is shown to be the optimum power allocation algorithm [37], Eq 16. The ergodic capacity of SR-hop and RD-hop under the source transmit power P SR and relay transmit power P RD respectively with waterfilling can be shown as At the iteration number k, the term C S i R i ðkÞ and C R i D i ðkÞ are less or equal the terms C S i R i ðk À 1Þ and C R i D i ðk À 1Þ, respectively. As at each irritation the step ζ(n) is subtracted from either P SR or P RD leading to the convergence of the proposed algorithm.

Joint power allocation algorithm for source-Relay nodes
To further improve the performance, the total transmit power allocation at the source and relay can be optimized jointly based on the network power constraint. Maximizing the ergodic capacity of SR-hop and RD-hop is accomplished by formulating an optimization problem under a total network power constrain P t .
Notice that Eqs 56 and 57, have been studied under the condition that P SR and P RD are fixed, i.e., the source and relay do not work cooperatively. This means that every node should have their own power constraint which does not depend on the power consumption of other nodes. The advantage of this scheme is that the optimization problem can be calculated separately at each node. The disadvantage of separate power constraints at the source and relay is reducing the total capacity. Hence, a joint transmit power optimization of the source and relay would offer a higher capacity. Recall that the total system capacity is limited by the minimum of SR-hop and RD-hop. In such scenario, the transmit power at the weaker hop can be increased while the transmit power at the stronger hop is reduced. This motivates us to consider the joint PA for SR-hop and RD-hop to further improve the spectral efficiency, which simultaneously requires the solution of the following optimization problem s:t:; P SR þ P RD ¼ P t ð59Þ The total system capacity is limited by the minimum SR-hop and RD-hop. To further optimize the system capacity, joint power allocation between the source and relay is considered. We further denote A 1 ¼ p 1 ; p 2 ; ::: where c* is the optimum value of c, and d* is the optimum value of d. From the dual composition, the partial Lagrangian [39], which can be obtained as The dual function in Eq 58 is given by The solution of Eq 59 can be obtained as

Max qðrÞ
Such thatg � 0 Eq 58 has a sub-gradient as follows where z(n) is the convergence step and t is the iteration parameter. From Eq 63, the individual source and relay power is regulated by the master algorithm that is similar to the waterfilling power algorithm. To find the optimum value of P SR and P RD , Algorithm 1 is applied where C SR (P SR ) is a function of the aggregate power of source and C RD (P RD ) is a function of P RD . To initiate the algorithm, we assume that C S i R i ðP SR Þ > C R i D i ðP RD Þ.

Numerical results
To validate the proposed scheme with the comparable baseline schemes, Monte Carlo simulation results are provided and averaged over 10000 channel realizations. Equal power allocation (equal PA) assumes that the sources and relays have a unity transmit power and are subjected to an aggregate power constraint, i.e., P SR = P RD = 1, otherwise waterfilling and joint power allocation (Joint PA) splits the power between the source and relay. Recall that in the proposed scheme, the relay BF matrices are designed to mitigate the RSI, and IRI, while the destination BF matrices are designed to mitigate the RDI. Fig 3 shows the ergodic capacity for the proposed scheme with joint power allocation for M s = 2, N ri = N rj = N r = 4, M ri = M rj = M r = 6 and N d = 4 number of antennas compared to baseline schemes with equal power allocation. With the increase in SNR, the performance of the FD without interference cancellation remains flat because it is limited by the RSI, IRI, and RDI. The proposed scheme has well dealt with IRI, RSI, and RDI and the channel is tending to be well conditioned, due to joint PA [8,18,40,41]. Moreover, a higher multiplexing gain (evident from the steep slope) is achieved by FD relaying, as compared to HD relaying. This is because the FD relay utilises the channel more efficiently. With proper RSI, IRI and RDI cancellation, the proposed FD relay based on nullspace projection achieves performance close to the ideal FD relay (no interference). The ideal FD relay capacity as shown in Section 5 is almost capacity achieving in scenarios where the C SR and C RD is sufficiently high because the RSI, IRI, and RDI are not considered. Even-though, the proposed scheme projects the RSI, IRI and RDI to the nullspace of the RSI, IRI and RDI

PLOS ONE
channels respectively, the proposed scheme achieves the same multiplexing gain as the ideal FD relay, evident from the slopes of the ergodic capacity curves. Fig 4 shows the sum ergodic capacity by considering both the FD and HD relays-assisted networks. In general, the higher number of antennas produces higher capacity and multiplexing gain, because of high number of parallel streams that supported by the system. In fact, this is due to the increasing design freedom of the nullspace based relay transmit and receive beamforming design. A higher number of antennas is required at the relay and destination nodes if compared to the source node because the number of antennas must fulfill N di � min(M rj , N dj ) + min(M ri , N di ), and N dj � min(M ri , N di ) + min(M rj , N dj ) to ensure the interference can be fully removed and provide sufficient degrees of freedom for the intended signal recovery [42,43]. The slope of the curve denotes the diversity gain, which indicates how robust the system is when more antennas are added [44]. Fig 5 compares the sum capacity of HD and FD relays, bench-marked with the comparable baseline HD and FD schemes. We observe that the proposed scheme efficiently suppresses the interferences, and provides a significant capacity gain over the sum capacity of HD and FD system without interference cancellation for the whole range of SNR. The latter system is limited by the noise at low SNR and interference at high SNR [41,43]. The sum capacity of the proposed scheme displays the same multiplexing gain (evident from the parallel slope) as the ideal interference free scheme [44]. The outage probability for FD MIMO relaying is expressed as the probability that the instantaneous capacity falls below a given transmission rate threshold < [33,45]. Therefore, the outage probability is obtained by min ðP out ð<Þ; � P out ð<ÞÞ, mathematically expressed for equal PA and joint PA, respectively as P out ð<Þ ¼ P r ðC < <Þ; ð65Þ � P out ð<Þ ¼ P r ð � C < <Þ; ð66Þ Fig 6 compares the outage probability of the proposed scheme with joint power allocation and comparable baseline schemes with equal power allocation for M s = 2, N r = 4, M r = 6 and N d = 4 antenna configurations and the target data rate < is 3 bits/s. The outage performance of the comparable baseline FD and HD schemes with RSI, IRI, and RDI (without interference cancellation) experiences an outage floor at high SNR. In contrast, the outage probability of the proposed scheme decreases in proportional to the SNR, because the relay is able to cancel the RSI and IRI while the destination is able to cancel the RDI [42,45]. From the slope of the curves, it can be seen that the proposed scheme achieves the same diversity order as the ideal scheme. Fig 7 illustrates the outage probability vs different targeted data rates for fixed SNR. As it can be observed that the proposed scheme for HD and FD relaying with joint power allocation delivers performance closest to the ideal FD and HD Relay (no interference is considered). This means that the RSI, IRI and RDI have been well dealt with and the channels are tending

PLOS ONE
of distance on the outage probability on the different relays. The probability of an outage for different distances decreases the channel gain resulting in a higher outage probability. There is a remarkable difference in the outage when d 3 = 200m compared to d 3 = 400m. It's evident that the highest distance between the relays has the worst outage floor performance and requires more power to transmit. In contrast, when the distance between the relays decreases, the diversity order remains the same due to the efficient RSI, IRI and RDI mitigation. In particular, the beamforming is designed to project the received signals onto the nullspace of the interference channels [8,40].

Conclusion
In this paper, a heterogeneous network assisted with MIMO HD and FD relays and affected by the interferences: RSI, IRI and RDI is investigated. An interference-aware BF scheme that simultaneously mitigates various combinations of RSI, IRI, and RDI is proposed. The detrimental effect of RSI, IRI, and RDI is removed using nullspace projection techniques at the transceivers. A heterogeneous network deployment becomes possible after canceling the RSI, IRI, and RDI, which offers a significant improvement over the sum capacity and outage probability of FD and HD schemes. This enables the FD to offer close to twice the conventional HD capacity. Further, from the slope of the sum rate, the proposed scheme achieves the same multiplexing gain as the ideal scheme. The results suggest that the ergodic capacity and outage probability can be significantly improved via joint power allocation with hybrid zeroforcing and singular value decomposition (ZF-SVD) beamforming technique.